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Abstract 

We discuss energy-momentum tensor and the second law of thermo- 
dynamics for a system of relativistic diffusing particles. We calculate 
the energy and entropy flow in this system. We obtain an exact time- 
dependence of energy, entropy and free energy of a beam of photons in a 
reservoir of a fixed temperature. 

1 Introduction 

A probabilistic description of a particle in an environment of some other parti- 
cles is well-knovifn in the non- relativistic classical and quantum mechanics [1]. 
The criteria for a diffusive approximation of such systems have been discussed 
for a long time. The diffusive approximation determines a single particle prob- 
ability distribution. Then, we may consider a stream of particles with the same 
probability distribution and apply methods of statistical mechanics for a thermo- 
dynamic or hydrodynamic description of such a system. This is the well-known 
model of non-equilibrium thermodynamics [2] [3] . 

A relativistic diffusion approximation is less developed (for a review see 
[4] [5]). There are prospects for applications mainly in heavy ion collisions, 
plasma physics (ordinary electron-ion plasma and quark-gluon plasma) and in 
astrophysics [6]. There are obstacles in such an approach because relativistic 
dynamics of multiparticle systems encounters some conceptual problems. Quan- 
tum field theory gives a relativistic description of scattering processes. However, 
it encounters difficulties with a notion of interacting particle systems at a finite 
time. Nevertheless, if we interpret the Wigner function as the probability distri- 
bution then relativistic transport equations can be derived from quantum field 
theory [7] [8] . A diffusion approximation to such equations has been applied in 
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high energy physics [9] [10] [11] [12]. In astrophysics a diffusion approximation to 
a description of light moving through a space filled with an electron gas has 
found wide spread appHcations [6]. 

Putting aside the problem of a derivation of a diffusion equation from multi- 
particle dynamics we can ask the question about its mathematical form if it is to 
satisfy the postulates of the relativistic mechanics. The mathematical problem 
of a relativistic diffusion has been posed by Schay [13] and Dudley [14]. It comes 
out that if the particle mass is defined as the square of the four-momentum and 
the diffusion is to be a Markov process then the answer is unique. The generator 
of the diffusion must be defined on the mass-shell as the second order relativistic 
invariant differential operator. We usually are interested in systems which are 
close to equilibrium (otherwise a mathematical description would not be feasi- 
ble). The notion of an equilibrium is relativistically covariant but not invariant. 
If we assume the usual postulates of equilibrium statistical mechanics then the 
reversible relativistic Markov process is uniquely determined by the detailed 
balance principle. We have discussed relativistic diffusions with an equilibrium 
distribution in [15] [16]. 

Many particle systems can also be described approximately by relativistic 
hydrodynamics. The hydrodynamics can in principle be derived from mechanics 
or through an intermediate approximation step from diffusive dynamics. The 
form of the energy-momentum tensor (as expressed by fluid velocity) constitutes 
the basic assumption of the relativistic hydrodynamics [17] [18] [19]. We discuss 
the energy-momentum tensor in diffusion theory (sec. 3) but do not attempt 
to derive its hydrodynamic form as expressed by fliiid velocity. The energy- 
momentum tensor is defined by the particle's probability distribution on the 
phase space. It is not conserved because the energy of a stream of particles is 
dissipated in a medium. The diffusion equations determine the time evolution 
of the energy-momentum tensor. The definition of the probability distribution 
and an equilibrium distribution allows to define the relative entropy (sec. 4) (the 
relative entropy for a class of relativistic diffusions is discussed also in [20] [21]) 
which in the theory of non-relativistic diffusions has been related to free energy 
[22] and subsequently to the entropy and internal energy. The relation of the 
relative entropy to the thermodynamics of non-relativistic diffusing systems has 
been discussed in [22] [23] [24]. In this letter we show such a relation for rela- 
tivistic diffusions. We obtain equations for a time evolution of the energy and 
entropy. The case of a diffusion of massless particles is exactly soluble. We have 
shown [25] that the diffusion of massless particles can be considered as a linear 
approximation to the non-linear Kompaneets diffusion [26]. In this letter (sec. 5) 
we obtain exact results for a time evolution of energy and entropy of radiation 
within a linear relativistic diffusion theory. 
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2 The relativistic diffusion 

Following [13] [14] [15] we begin with a proper time evolution of a function (j) on 
the phase space 

dr(i> = g^ = {p''d; + A)<j>, (1) 

where A is the second order differential operator defined on the mass-shell 

u 2 2 2 2 

Differentiation over space-time coordinates has an index x whereas differenti- 
ation without an index concerns momenta, space-time indices are denoted by 
Greek letters whereas spatial indices by Latin letters. The probability density 
$ evolves according to an adjoint equation 

dr^r = e**r = (-p^^^ + ^*)*r (2) 

resulting from 

J da;dp^r(a;, p)$(a;,p) = J dxdp(j>{x,p)^Tix,p). (3) 

The probability density $ of a particle in a laboratory frame is independent of 
T and (from eq.(2)) is the solution of the equation 

= 0. (4) 

If we choose the spatial momenta p as coordinates on the mass-shell then the 
0(3, 1) invariant diffusion generator reads 

= Ah = {Sjk + m-^c-^PjPk)^^ + 3m-^c-^pk^. (5) 

We shall also use = to~^c~^7^ as the diffusion constant. A diffusion gener- 
ated by ^0 does not have a finite equilibrium measure. In order to achieve an 
equilibrium we add a friction term R = Rjd^ to Ao- Now, 

A = Ao + Rj&> = Ajkd^d'' + Bjd^ , (6) 

where the drift B is 

3^2 

Bk = Rk + —Pk- (7) 
In an electromagnetic field we still add the force 

G=—Fj,p-'d^, (8) 
mc 
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(where e is an electric charge and fj^i/ is the electromagnetic field strength 
tensor). 

We assume that there exists a time independent equilibrium solution of 
eq.(4). If the Markov process is reversible [27] then the probability distribution 
$ and the invariant measure satisfy the detailed balance condition [22] which 
determines the drift i? as a function of the invariant measure. Applying basic 
assumptions of the classical relativistic statistical mechanics we can conclude 
that the equilibrium distribution of free relativistic particles is (the Jiittner 
distribution [28]) 

=Po^cxp(-/3cpo)- (9) 

where /3~^ = ksT, ks is the Boltzmann constant and T is the temperature, 
determines the drift 

^2 

Rj = -^Pjlicpo- (10) 

We can also find an equilibrium measure of a particle in an electric field. Under 
the assumption that only the spatial components Fqj = —cdjV of Fj^j/ are 
different from zero we have 

= eM-P{cpo + el/)). (11) 

Then, the drift is 

Rj = —PjPcpo + —podJV (12) 
2 mc ■' 

(it could be obtained by an addition of the force (8) to the friction (10)). 

The limit to — > is particularly simple. It can be obtained as the limit 

TO of the time evolution exp(rTO^^) [25]. Then, eq.(4) reads 

\p\dt^ = ^d^d%pk^ - ^d^pj^ + ^/3c25^p,|p|$ + cpV^^ (13) 

We write 

$ = ^E^ (14) 

and r = |p|. Then, the equation for 'J'(]p], n, x) is related to the Bessel diffusion 
[29] 

d,^ = "-^^rdl^ + (^ - ^r)dr^ - cnV.*, (15) 
where n = p|p|~^ is a fixed vector. 

3 Energy-momentum tensor 

We define a configuration space density 

p(x)= / dp$(x,p). (16) 
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The particle density current is defined by 

= j dpp''$(a;,p). (17) 

From the transport equation (4) we derive the current conservation 

d^N" = 0. (18) 

As a consequence 



^ — J dxN'^ = J dxdppo^ = const. 



(19) 



We we can apply eq.(19) to normalize the probability distribution. 
We define the energy-momentum tensor [8] 



(20) 



The energy-momentum tensor gives a covariant description of a continuous dis- 
tribution of the energy and momentum. Tq^ has the meaning of the four- 
momentum density current. Then 

determines the four-momentum of a stream of particles. We can write 

Toi, = j dpO(p,x)p^ (21) 

where the physical meaning of Tq^ and imply that r2(p,x) = $(p,x)po is 
the phase space probability distribution (after a normalization). 

We obtain simple equations for the divergence of the kinetic energy-momentum 
in an electromagnetic field at /3 = (no friction). Then, 

d^^T^^ = —N, + —F^^N'^. (22) 

2 mc 

If friction is present then we consider a diffusion in the electric field = —d^V 
( in such a case eq.(4) has an equilibrium solution (11)). Then, from eq.(4) 

d^T^o = —No - -pcToo + -Prn'^c^p + -d^YNk (23) 

and 

d'^T^k = -^Nk - -pcTok + —dkVN^. (24) 
2 2 mc 
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Eqs.(23)-(24) say that the flow of energy and momentum is determined by the 
currents. 

The kinetic energy can be defined as 

W = cVo = c j dxToo = c j rfxdp$Po. (25) 

Then, from eq.(23) 

d^W = - ^/3cW + ^/^m^c^ fd^p+- [ dxVVN (26) 

z / z J Tn J 



where the normaUzation constant (19) in the case of a potential V is denoted 

It follows from eq.(26) that if there is no friction (/3 = 0) and no potential 
{ V = 0) then the energy grows linearly in time. If we include the external 
potential V into the energy 

= y dx(cToo + epoV^) = J dpO(p)(cpo + eV) = W + e{V). (27) 

then eq.(26) reads 

doWv = ^k'cZ^ - ^/3cW + ^/Sm^c^ / rfxp. (28) 

z A A j 

We show that the energy Wy is bounded if V is bounded and /3 > 0. Let 

V = j^K^c^. (29) 
We write eq.(28) in an integral form 

(30) 



Wv{t) = exp(-f i)Wy(t = 0) 



+^ exp(-|t) Jo exp(|s)(3Z^ + /Jc^m^ / rfxp + ep{V))ds. 
Then, from eq.(28) and the inequality 

j dxp < j dpdx{mc)~^po^ = {mc)~^Z^ 

we have 

Wv < exp{-^t)Wv{t = 0) + (l - exp(-^i)) Z^(3 + fimc' + e^v), (31) 
where v = sup\V\. 
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4 Relative entropy, entropy and free energy 

The relative entropy (also called Kullback-Leibler entropy) determines a dis- 
tance between two probability measures . Define the relative entropy of two 
unnormalizcd probability distributions $ and {Z and Ze are the normal- 
ization constants) as 

Sk{^;^e) = Z-^ J rfxdppo^ln (^Z-^^^e)'^ Ze) , (32) 

where 

Ze — J dxdpexp{—f3cpo) (33) 

(the system must be in a finite volume if Ze is to be finite). It is known that 
[30] 

Sk{^; ^e) > 0. (34) 
An easy calculation using the transport equation (4) gives 

doSK{^;^E) = -Z-^ J dpdx^Ajkdj hiQdk InQ < 0, (35) 

where 

Q = $($e)-^ (36) 

and Ajk is defined in eq.(6). Eq.(35) holds true for any two probability distribu- 
tions solving the same Fokker-Planck equation [30]. It follows from eqs.(34)-(35) 
that Sk{^', ^e) is a non- negative function monotonically decreasing to zero at 
the equilibrium ^e (however, the gradients in eq.(35) do not depend on the po- 
tential V). For non-relativistic diffusions the properties of the relative entropy 
are known for a long time [22] [30] [31] [32] (the decrease of the relative entropy 
for a class of relativistic diffusions has been shown in [20] [21]). 
The relative entropy in an electric field is 

Sk{^; $^) = Z-i / dxrfppo* In [z-'^Z^ exp(/3(cpo + eF))) . (37) 
Z^ = J dxdpexp{-p{cpo + eV)). (38) 



Here 



If we have a single particle distribution $ then we can define the entropy current 
5''($) = -kB J ^P^'iPo^) In (po*) (39) 
and the Boltzmann entropy 

5($) = j dxS\^). (40) 
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From the definitions (25), (32) and (40) wc obtain the relation 



ZSk{^; ^e) = -ks^S + pW + Zln{ZEZ-^) (41) 

We define the free energy 

J' = p-^ZSK{^;^E)-Zp-Hn{ZZ^') (42) 

and in a potential V 

Ty = r^Z^SK{^- $^) - (Z^)-i/3-i ln(Z^(Z^)-i) (43) 

Then, from eqs.(25),(40) and (42) we obtain the basic thermodynamic relation 

TS = y^-T. (44) 

Z has the meaning of the mean number of modes. We can define the energy 
per mode 

w = Z-^W (45) 
/ = Z~^T and s = Z~^S. Then, the thermodynamic equality (44) reads 

Ts = w-f (46) 

We can calculate the time derivative of the entropy 



TdaS = doW - doT 

= ^Z- ^l3cW + ^I3m^c'^ Jdxp + J dpdx^Ajkdj In Qdk In Q 



(47) 



{Q = $$^^).Thc negative contribution to the change of entropy comes from 
the energy loss into the surroundings caused by the friction in the medium 
(see the discussion of the entropy balance in [2] [3] ) . The question whether the 
entropy is increasing or not depends on the relative strength of the terms on 
the rhs of eq.(47). The last term on the rhs of eq.(47) tends to zero when the 
equilibrium is approached. The sum of first three terms also tends to zero. In 
order to prove this we take the equilibrium limit on the rhs of eq.(47) (here 
z = J dpexp{-j3cpo)) 



= - \l3c J dppo exp(-/3cpo) + ^/^m^c"' / dpp^'' exp(-^cpo) = 



(48) 



The result (48) comes from direct calculations of the integrals (with a use of 
some identities for modified Bessel functions K^). We can see that at large 
time there is a subtle cancellation of the first three terms with the last one 
on the rhs of eq.(48). Such an entropy balance is characteristic for a system 
exchanging energy (and entropy) with the surroundings of the system until it 
achieves an equilibrium [2] [3]. The problem whether the entropy <S grows or 
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not may depend on the initial conditions, on the temperature and on time. If 
we choose the initial condition $ so that the initial W is small and far from its 
equilibrium value then the rhs of eq.(47) will be positive for a small time and 
will continue to be positive until it approaches zero when t ^ oo and $ — )■ 
In the opposite case of large initial W the entropy begins to decrease at t = 
and it may continue doing so as time goes on. In the Appendix we consider 
an example of a beam of particles prepared at i = in the equilibrium state of 
temperature T'. We calculate the rhs of eq.(47) at t = 0. If T' > T the energy 
and entropy start to decrease (although —T grows) because of the dissipation 
of the energy in the reservoir. In the opposite case T' < T the beam acquires 
the energy and the entropy from the reservoir (hence, OqS > 0). The beam 
can gain the entropy till it achieves the equilibrium at the temperature T. In 
the next section we prove that this is exactly so in a soluble model of diffusing 
photons. 

We could calculate the time derivative of the entropy directly from the def- 
inition (40) 

9o5($) = -kB J ((pV + ^*)$) ln(po$) -ksj (pV + A*)^. (49) 

Eq.(49) shows (as A*'^e = 0) that 

doS{^E) = (50) 

(no entropy production in an equilibrium). The conclusion (50) is in agreement 
with (48) because ^ ^ as t ^ oo. 



5 Thermodynamics of diffusing photons 

We have shown in [25] [33] that a diffusion of photons can be described by the 
limit TO — )■ of the diffusion equation. This equation can be solved explicitly. 
We write $ = ^e'^- Wc choose the initial condition ^ for eq.(15) in the form 
of the Laplace transform (n = pjpj^^) 

POO 

*(x,p) =*(x,|p|,n) = / da*(x,o-,n)exp(-ac|p|). (51) 
Jo 

First, we choose ^ = S{a — A). Let 

A(A,t)= (l + Ar'(l-exp(-^))), (52) 
then the solution of eq.(15) with the initial condition exp(— cAjpj) is [29][16] 

*t'^(p) = A(A,t)-3exp(- A(A,i)-'cAexp(-|i)|p|). (53) 
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In general, 

*f(x,|p|,n) = / c?cr#(x-nci,a,n)4'^(p). (54) 
Jo 

From eqs.(52)-(54) we obtain the limit 

limt^ooj rfxrfp$t(x,p)M(p) = / dp^EM{p) 
(/rfxdp*(x,p)exp(-c/3|p|)) (/rfpexp(-c^|p|))"\ ^^^^ 

Let 

M{p)=poH{p). (56) 

Then, eq.(55) can be expressed in a form which looks like a standard limit of 
mean values 

limt_).oo / (ixdp$t(x, p)poH{p) ( J dxdp^tPo] 

V ^ (57) 

= J dp^EPoH{p)\^J dppo^E) ■ 

We can study the time dependence of thermodynamic functions explicitly using 

the explicit solution of the diffusion equation. When m = and V = then we 
obtain a closed equation (28) for W with the solution 

W{t) = exp(-|f)>V(t = 0) + 3Z/3-i(l - exp(-f i)). (58) 

We study in more detail the case 

= = po ' exp(-^'cpo) = exp(-cA|p|), (59) 

(in a finite volume which we set as 1) where 

X = [3' -13. (60) 

The state describes a beam of photons coming from a source of a fixed 
temperature T'. We are interested in a time evolution of this beam when passing 
through a medium of a fixed temperature T. Wc assume that the interaction 
of photons with the medium can be described approximately as the diffusion. 
Such an approximation has been established by Kompaneets in a model of an 
interaction of photons with an electron gas [26]. In eq.(58) for the model (59) 
we have 

H;(f = 0) = c j dppl^'s = 2A-Kc{c(3 + cA)"^ = 2A'kc-^ (3'-'^ (61) 
(the Stefan-Boltzmann law) and 

Z = j dppQ^E = 87r(c/3 + cA)-^ = Sttc-^/J'-^ (62) 
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Hence 

W{t) = 247rc-^/3-V"^ - 247rAexp(-^t)c-3/3-V'-^ (63) 

and 

/3'4(247r)-iZc35if($'B,$£;) = -/3'ln (l + Xp-\l - exp(-|i))) - Aexp(-ft). 

(64) 

Hence, 

dtJ^= -12TTc-^X^iyp-^P'-^exp{-iyt)(^{l + Xp-\l-exp{-'^t))^ \ (65) 

dtW = UttXc-^k'^P'-^ exp(-^i) (66) 

and ^ 

dtS = UttXk'^c-^IS'-^ exp(-^t) (l + A^-^ exp(-^t)) " , (67) 

Eq.(67) means that the change of the entropy has the same sign as the change of 

energy (66), i.e., if the temperature of the system is higher than the temperature 
of the reservoir then the entropy of the system is decreasing, because the energy 
is flowing into the reservoir. If the temperature of the reservoir is higher than 
the temperature of the system then the entropy of the system is increasing. 
The total change of the entropy of the system plus the reservoir (the entropy 
production) is described by [2] [3] -dtJ" = TdtS - dtW > 0. 

Note that the energy per mode w{t) (45) tends from its initial value 
w{t = 0) = 3/3'~^ to the equilibrium limit 'w{t = oo) = 3(3~^ in accordance 
with the equipartition theorem for massless particles. 

6 Discussion 

We have extended the diffusion model of non-equilibrium thermodynamics [2] 
to rclativistic diffusions. The model describes a balance of entropy and energy: 
the exchange of the entropy with the surroundings and the entropy production 
inside the system. The time derivative of the relative entropy (with an opposite 
sign) is interpreted as the entropy production in the total system consisting of 
the rclativistic diffusing particles and the reservoir [2] [3] [23]. Such models can 
be useful in a description of a beam (fluid) of relativistic particles moving in a 
medium. As an example we could consider a motion of light through the space 
fllled with electrons [6] [26] (this could include the initial stage of the Big Bang 
[34]); for a discussion of some other applications of non-equilibrium radiation 
theory see [35] . We could consider also a diffusive motion of a heavy quark in the 
plasma of gluons and light quarks. Such a model of diffusion (after an extension 
to open systems) can be tested in the LHC experiments [12]. The entropy 
exchange can play an important role in a description of heavy ion collisions [36] . 
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In this letter we have discussed a diffusion equation with a probabihty dis- 
tribution tending to the classical relativistic (Jiittner) equilibrium distribution. 
Wc could consider in the diffusion equations (2) the drifts leading to the quan- 
tum equilibrium distributions. However, in such a case the thermodynamics will 
change substantially, e.g., the entropy for Bose-Einstein particles should have 
the form 

S = - J dxrfppo^lnpo^ + J dxdp{l + po^)in{l + po^) 

instead of cq.(39). The classical statistical thermodynamics is valid in the limit 
of large (3cpQ. If this condition is not satisfied then quantum phenomena ap- 
pear. In the photon case there arc; bunching (enhancement) effects resulting 
from Bose-Einstein statistics described by non-linear terms in the Boltzmann 
equation [6] [26] ( there is the Pauli blocking factor in the case of the Fermi-Dirac 
statistics) . Only in the limit of low photon density these non- linear terms can 
be neglected. A discussion of thermodynamics with quantum equilibrium distri- 
butions requires non-linear relativistic diffusion equations which will be studied 
in forthcoming publications. 



7 Appendix 

Lcit us assume that the initial state $^ is an equilibrium state but with a 
temperature T' different from the temperature T of the reservoir 

^'e = exp(-/3'cpo) 

We are unable to obtain an exact time evolution of energy and entropy of a 

stream of massive particles. However, we can obtain their evolution for a small 
time calculating the time derivatives at t = from eqs.(26) and (35). First, for 
the initial distribution 

dtW{t = 0) = - ^(ic^Wo + ^[3w?c' J djcp 

= Sttk^c- V"^(l - ^)K2{mc'^P'){mc^l3'f 

Then, after a calculation of doSxi^'Ej^E) from eq.(35) we obtain 

doJ^{t = 0) = -67r/t\^/3-^m2(l - ^fK2{mc'^l3') 

(where K^, denotes the modified Bessel function of order i/). The limit to — )• 
of these formulas agrees with eqs.(65)-(67) at t = as K2{x) ~ 2x~'^ for a small 

X. 
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